Pandas Profiling Report

Dataset statistics

Number of variables	9
Number of observations	3132
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	220.3 KiB
Average record size in memory	72.0 B

Variable types

NUM	8
CAT	1

Reproduction

Analysis started	2020-08-24 21:34:15.038038
Analysis finished	2020-08-24 21:34:31.760836
Duration	16.72 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`Diameter` is highly correlated with `Length` and 2 other fields	High correlation
`Length` is highly correlated with `Diameter` and 3 other fields	High correlation
`Whole weight` is highly correlated with `Length` and 4 other fields	High correlation
`Shucked weight` is highly correlated with `Whole weight` and 1 other fields	High correlation
`Viscera weight` is highly correlated with `Length` and 3 other fields	High correlation
`Shell weight` is highly correlated with `Length` and 3 other fields	High correlation

Sex
Categorical

Distinct count	3
Unique (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	24.5 KiB

M	1138
I	1013
F	981

Common Values
Length

Value	Count	Frequency (%)
M	1138	36.3%
I	1013	32.3%
F	981	31.3%

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Length
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	133
Unique (%)	4.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.5237068965517241
Minimum	0.11
Maximum	0.815
Zeros	0
Zeros (%)	0.0%
Memory size	24.5 KiB

Quantile statistics

Minimum	0.11
5-th percentile	0.295
Q1	0.45
median	0.545
Q3	0.615
95-th percentile	0.69
Maximum	0.815
Range	0.705
Interquartile range (IQR)	0.165

Descriptive statistics

Standard deviation	0.1198914431
Coefficient of variation (CV)	0.2289285169
Kurtosis	0.04474549084
Mean	0.5237068966
Median Absolute Deviation (MAD)	0.08
Skewness	-0.636597264
Sum	1640.25
Variance	0.01437395814

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.55	72	2.3%
0.625	71	2.3%
0.62	68	2.2%
0.575	68	2.2%
0.58	65	2.1%
0.6	64	2.0%
0.5	63	2.0%
0.52	58	1.9%
0.57	57	1.8%
0.59	56	1.8%
Other values (123)	2490	79.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.11	1	< 0.1%
0.13	2	0.1%
0.135	1	< 0.1%
0.14	2	0.1%
0.15	1	< 0.1%

Value	Count	Frequency (%)
0.815	1	< 0.1%
0.8	1	< 0.1%
0.78	2	0.1%
0.775	1	< 0.1%
0.77	2	0.1%

Diameter
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	110
Unique (%)	3.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.4079517879948914
Minimum	0.09
Maximum	0.65
Zeros	0
Zeros (%)	0.0%
Memory size	24.5 KiB

Quantile statistics

Minimum	0.09
5-th percentile	0.22
Q1	0.35
median	0.425
Q3	0.48
95-th percentile	0.545
Maximum	0.65
Range	0.56
Interquartile range (IQR)	0.13

Descriptive statistics

Standard deviation	0.09933632486
Coefficient of variation (CV)	0.2435001581
Kurtosis	-0.07025117819
Mean	0.407951788
Median Absolute Deviation (MAD)	0.065
Skewness	-0.6038878442
Sum	1277.705
Variance	0.009867705436

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.45	102	3.3%
0.475	96	3.1%
0.5	86	2.7%
0.4	82	2.6%
0.47	71	2.3%
0.48	71	2.3%
0.465	70	2.2%
0.375	69	2.2%
0.455	67	2.1%
0.46	66	2.1%
Other values (100)	2352	75.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.09	1	< 0.1%
0.095	1	< 0.1%
0.1	2	0.1%
0.105	2	0.1%
0.11	2	0.1%

Value	Count	Frequency (%)
0.65	1	< 0.1%
0.63	3	0.1%
0.625	1	< 0.1%
0.62	1	< 0.1%
0.615	1	< 0.1%

Height
Real number (ℝ_≥0)

Distinct count	49
Unique (%)	1.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.13927681992337165
Minimum	0.0
Maximum	0.515
Zeros	1
Zeros (%)	< 0.1%
Memory size	24.5 KiB

Quantile statistics

Minimum	0
5-th percentile	0.075
Q1	0.115
median	0.14
Q3	0.165
95-th percentile	0.2
Maximum	0.515
Range	0.515
Interquartile range (IQR)	0.05

Descriptive statistics

Standard deviation	0.03899113805
Coefficient of variation (CV)	0.2799542527
Kurtosis	2.449882236
Mean	0.1392768199
Median Absolute Deviation (MAD)	0.025
Skewness	0.03735663857
Sum	436.215
Variance	0.001520308846

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.15	200	6.4%
0.155	169	5.4%
0.14	167	5.3%
0.175	166	5.3%
0.16	151	4.8%
0.125	149	4.8%
0.165	147	4.7%
0.135	146	4.7%
0.12	136	4.3%
0.145	132	4.2%
Other values (39)	1569	50.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
0.015	1	< 0.1%
0.02	1	< 0.1%
0.025	4	0.1%
0.03	6	0.2%

Value	Count	Frequency (%)
0.515	1	< 0.1%
0.25	3	0.1%
0.24	3	0.1%
0.235	4	0.1%
0.23	9	0.3%

Whole weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	2037
Unique (%)	65.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.828670019157088
Minimum	0.008
Maximum	2.8255
Zeros	0
Zeros (%)	0.0%
Memory size	24.5 KiB

Quantile statistics

Minimum	0.008
5-th percentile	0.1275
Q1	0.4415
median	0.7995
Q3	1.153
95-th percentile	1.70095
Maximum	2.8255
Range	2.8175
Interquartile range (IQR)	0.7115

Descriptive statistics

Standard deviation	0.4906301983
Coefficient of variation (CV)	0.5920694449
Kurtosis	0.03429973195
Mean	0.8286700192
Median Absolute Deviation (MAD)	0.35575
Skewness	0.5466790619
Sum	2595.3945
Variance	0.2407179914

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.2225	8	0.3%
0.97	6	0.2%
0.494	6	0.2%
0.18	6	0.2%
0.717	5	0.2%
0.197	5	0.2%
0.196	5	0.2%
0.4775	5	0.2%
0.874	5	0.2%
0.487	5	0.2%
Other values (2027)	3076	98.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.008	1	< 0.1%
0.0105	1	< 0.1%
0.013	1	< 0.1%
0.014	1	< 0.1%
0.0145	1	< 0.1%

Value	Count	Frequency (%)
2.8255	1	< 0.1%
2.7795	1	< 0.1%
2.657	1	< 0.1%
2.55	1	< 0.1%
2.548	1	< 0.1%

Shucked weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	1390
Unique (%)	44.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.35922860791826305
Minimum	0.0025
Maximum	1.4880000000000002
Zeros	0
Zeros (%)	0.0%
Memory size	24.5 KiB

Quantile statistics

Minimum	0.0025
5-th percentile	0.0545
Q1	0.185375
median	0.3355
Q3	0.4995
95-th percentile	0.741225
Maximum	1.488
Range	1.4855
Interquartile range (IQR)	0.314125

Descriptive statistics

Standard deviation	0.2219457029
Coefficient of variation (CV)	0.6178397209
Kurtosis	0.601872859
Mean	0.3592286079
Median Absolute Deviation (MAD)	0.1575
Skewness	0.7237958254
Sum	1125.104
Variance	0.04925989502

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.175	9	0.3%
0.2945	8	0.3%
0.165	8	0.3%
0.2505	8	0.3%
0.2385	8	0.3%
0.096	7	0.2%
0.0415	7	0.2%
0.0675	7	0.2%
0.302	7	0.2%
0.097	7	0.2%
Other values (1380)	3056	97.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0025	1	< 0.1%
0.0045	2	0.1%
0.005	2	0.1%
0.0055	1	< 0.1%
0.0065	2	0.1%

Value	Count	Frequency (%)
1.488	1	< 0.1%
1.351	1	< 0.1%
1.3485	1	< 0.1%
1.2395	1	< 0.1%
1.232	1	< 0.1%

Viscera weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	843
Unique (%)	26.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.18073084291187738
Minimum	0.0005
Maximum	0.76
Zeros	0
Zeros (%)	0.0%
Memory size	24.5 KiB

Quantile statistics

Minimum	0.0005
5-th percentile	0.028275
Q1	0.093375
median	0.17
Q3	0.2525
95-th percentile	0.38
Maximum	0.76
Range	0.7595
Interquartile range (IQR)	0.159125

Descriptive statistics

Standard deviation	0.1099235988
Coefficient of variation (CV)	0.6082171534
Kurtosis	0.1636080714
Mean	0.1807308429
Median Absolute Deviation (MAD)	0.07925
Skewness	0.613185568
Sum	566.049
Variance	0.01208319757

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.156	12	0.4%
0.15	12	0.4%
0.037	11	0.4%
0.1715	11	0.4%
0.2145	11	0.4%
0.1415	10	0.3%
0.246	10	0.3%
0.1315	10	0.3%
0.1625	10	0.3%
0.1405	10	0.3%
Other values (833)	3025	96.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0005	1	< 0.1%
0.002	1	< 0.1%
0.0025	2	0.1%
0.003	1	< 0.1%
0.0035	2	0.1%

Value	Count	Frequency (%)
0.76	1	< 0.1%
0.6415	1	< 0.1%
0.59	1	< 0.1%
0.575	1	< 0.1%
0.5745	1	< 0.1%

Shell weight
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	830
Unique (%)	26.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.23915900383141764
Minimum	0.003
Maximum	1.005
Zeros	0
Zeros (%)	0.0%
Memory size	24.5 KiB

Quantile statistics

Minimum	0.003
5-th percentile	0.03955
Q1	0.13
median	0.235
Q3	0.33
95-th percentile	0.48
Maximum	1.005
Range	1.002
Interquartile range (IQR)	0.2

Descriptive statistics

Standard deviation	0.1390404721
Coefficient of variation (CV)	0.5813725175
Kurtosis	0.591303839
Mean	0.2391590038
Median Absolute Deviation (MAD)	0.1
Skewness	0.6192253654
Sum	749.046
Variance	0.0193322529

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0.265	34	1.1%
0.285	34	1.1%
0.185	33	1.1%
0.275	33	1.1%
0.25	31	1.0%
0.335	31	1.0%
0.315	30	1.0%
0.17	30	1.0%
0.235	29	0.9%
0.22	28	0.9%
Other values (820)	2819	90.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.003	1	< 0.1%
0.0035	1	< 0.1%
0.004	2	0.1%
0.005	7	0.2%
0.0065	1	< 0.1%

Value	Count	Frequency (%)
1.005	1	< 0.1%
0.897	1	< 0.1%
0.885	1	< 0.1%
0.85	1	< 0.1%
0.815	1	< 0.1%

Rings
Real number (ℝ_≥0)

Distinct count	26
Unique (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	9.947956577266922
Minimum	2
Maximum	29
Zeros	0
Zeros (%)	0.0%
Memory size	24.5 KiB

Quantile statistics

Minimum	2
5-th percentile	6
Q1	8
median	10
Q3	11
95-th percentile	16
Maximum	29
Range	27
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	3.230252485
Coefficient of variation (CV)	0.3247151774
Kurtosis	2.350069229
Mean	9.947956577
Median Absolute Deviation (MAD)	2
Skewness	1.131830046
Sum	31157
Variance	10.43453112

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
9	513	16.4%
10	487	15.5%
8	423	13.5%
11	351	11.2%
7	304	9.7%
12	210	6.7%
6	181	5.8%
13	161	5.1%
5	89	2.8%
14	87	2.8%
Other values (16)	326	10.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	1	< 0.1%
3	11	0.4%
4	42	1.3%
5	89	2.8%
6	181	5.8%

Value	Count	Frequency (%)
29	1	< 0.1%
27	1	< 0.1%
26	1	< 0.1%
25	1	< 0.1%
23	7	0.2%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	Sex	Length	Diameter	Height	Whole weight	Shucked weight	Viscera weight	Shell weight	Rings
0	F	0.525	0.400	0.135	0.7140	0.3180	0.1380	0.2080	10
1	F	0.445	0.325	0.125	0.4550	0.1785	0.1125	0.1400	9
2	M	0.710	0.540	0.165	1.9590	0.7665	0.2610	0.7800	18
3	F	0.680	0.580	0.200	1.7870	0.5850	0.4530	0.6000	19
4	M	0.605	0.470	0.160	1.1735	0.4975	0.2405	0.3450	12
5	I	0.555	0.430	0.125	0.7005	0.3395	0.1355	0.2095	8
6	M	0.510	0.405	0.125	0.6925	0.3270	0.1550	0.1805	7
7	M	0.655	0.520	0.180	1.4920	0.7185	0.3600	0.3550	11
8	M	0.540	0.415	0.145	0.7400	0.2635	0.1680	0.2450	12
9	M	0.515	0.410	0.140	0.7355	0.3065	0.1370	0.2000	7

Last rows

	Sex	Length	Diameter	Height	Whole weight	Shucked weight	Viscera weight	Shell weight	Rings
3122	M	0.625	0.475	0.160	1.0845	0.5005	0.2355	0.3105	10
3123	M	0.660	0.515	0.155	1.4415	0.7055	0.3555	0.3350	10
3124	I	0.500	0.375	0.120	0.5420	0.2150	0.1160	0.1700	9
3125	F	0.620	0.485	0.165	1.1660	0.4830	0.2380	0.3550	13
3126	M	0.455	0.345	0.150	0.5795	0.1685	0.1250	0.2150	13
3127	M	0.415	0.315	0.120	0.4015	0.1990	0.0870	0.0970	8
3128	I	0.325	0.240	0.070	0.1520	0.0565	0.0305	0.0540	8
3129	M	0.565	0.455	0.155	0.9355	0.4210	0.1830	0.2600	11
3130	M	0.610	0.485	0.145	1.3305	0.7830	0.2255	0.2865	9
3131	F	0.655	0.505	0.190	1.3485	0.5935	0.2745	0.4250	12

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows